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[57] ABSTRACT 

An automated retail point-of-sale machine is disclosed 
having the ability to allow consumers to check out their 
purchases with a minimal of direct human assistance. 
The machine is designed to work with products 
whether labelled or not with machine readable bar 
codes. The machine possess security features which 
deter customers from fraudulently bagging items, by 
comparing the weight changes on the packing scale 
with the product number related information in the case 
of labelleled products. In the case of nonlabelled prod- 
ucts, experienced customers can identify the product 
through a series of menu choices while beginner cus- 
tomers can allow the supervisory employee to enter a 
product number abbreviated code, with additional vi- 
sual .and/or. dimensional sensory information of the 
contents being relayed to a supervisory employee. The 
machine allows high shopper efficiency by minimizing 
customer handling of products by positioning the pack- 
ing scale adjacent to the scanner and typically not re- 
quiring further handling of the purchased items until 
checkout is completed. 

13 Claims, 7 Drawing Sheets 
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4,792,018. The Mergenthaler and Johnson inventions 
AUTOMATED POINT-OF-SALE MACHINE are quite similar. At a self-service station customers 

scan and weigh items (where weight is automatically 
FIELD OF THE INVENTION checked against produce code) and then place items 

The present invention relates to retail point-of-sale 5 bt0 a new (Johnson) or a bag (Mergenthaler) 
systems which allow the customer to check out pur- which is on a weighing receptacle. The new can or new 
chased items with a minimum of operator intervention bags are then brought to a checkout station where it is 
while preventing customer fraud. verified that the weight of the cart or bags has not 

changed. The Humble invention passes items on a con- 
BACKGROUND OF THE INVENTION 10 V eyer through a light tunnel after scanning. Not only is 
In most retail environments the customer selects van- weight determined and verified against product num- 
ous items for purchase and brings these items to an . ber, but the product's dimensions can also be deter- 
operator for checkout. The operator enters the price of mined and verified against product number thereby 
each item selected, as well as a code particular to the making substitution of similar weight items difficult, 
item, into a point-of-sale terminal which then calculates 15 The customer's items accumulate at the end of the light 
the total amount the customer must pay. After payment tunnel where they must later be bagged and presented 
is received the point-of-sale terminal calculates any . to an operator for payment. To prevent customers from . 
change owing to the customer and produces a written not scanning items and placing them at the end of the 
receipt for the customer. Over the last two decades light tunnel for bagging, the Humble invention suggests 
many retail products have been manufactured to con- 20 the use of an electronic surveillance system in the pedes- 
tain a machine readable bar code. In response, many than passage about the system. 

retail environments have incorporated an optical scan- j^e above inventions all have serious limitations with 
ner into their point-of-sale systems. The operator is able respect to customer fraud, shopping efficiency, non- 
to save time by scanning purchased items rather than coded pro ducts and use by nonexperienced users. In the 
having to manually key in price and product informa- 25 Mergenthaler and Johnson patents, customer fraud re- 
turn. When the operator scans a product the optical ^ important problem as customers can scan a . 
scanner sends a signal corresponding to. the product chcap item at thc ^.service station, discard it and 
number to the data processing component of the point- in^ediately substitute a more expensive similarly 
of-sale terminaLsystem. In the latter resides a product weighing itcm . Oespite the Humble patent's use of the 
lookup table which quicWy provides the price and the 30 - tQ determine kem $hape fa tQ 
description of the scanned item. ^ ^ customer need on]y place an item at the 
Many inventions have been proposed over the last , ' mm lt tu. »\„t*™\n c» r 
two decades to automate the poin£f-sale terminal by 

having the customer.scan the item himself/herself and ve,llance s yf m s t u ?« ested b * * e Hu , rable P atent " n ° l 
then place the item on a checkout weighing receptacle. 35 economy f «f ^ environments such as supermarkets. 
Since many items have predetermined weight the As n ° in / he Shapiro article, shoppers could con- 
point-of-sale terminal system need only compare the P ut *! oc ™ fro J? * eir mt0 

actual weight of the product placed on the checkout &opmg bags." In the Mergenthaler and Johnson 

weighing device with the weight given by the product P atents ' lltt,e attention is paid to shopper efficiency (as 
lookup table (i.e., along with the price and description 40 opposed to operator efficiency). Customers must handle 
information) to assure that the item placed on the ltems repeatedly^ place them from one weighing sta- 
checkout weighing receptacle is indeed the item tion to another. The Humble invention also does a poor 
scanned job with respect to shopper efficiency. After having 

One early prior art system for automated checkout is scanned and placed all the purchased items on the con- 
described in Ehrat U.S. Pat. No. 3,836,755. Ehrat's 45 vevor > the customer must once, again handle all the 
invention consists of a shopping cart which contains a items during the bagging operation. The Johnson inven- 
scanning and weighing apparatus and which in conjunc- *™ does make a limited provision for items not possess- 
ion with an evaluation system evaluates the correspon- mg a machine readable code by allowing customers to 
dence of weight with product designation! Another enter a code or price value. However, the items are not 
prior art system for automated checkout is described in 50 verified in any way by the invention. The Humble m- 
Clyne U.S. Pat. No. 4,373,133. dyne's invention con- vention pays more attention to products not containing 
sists of providing each customer's shopping cart with an a machine readable. Customers are presented with se- 
electronic recording unit which is used by the customer lection on a computer screen and the invention attempts 
to scan each item selected for purchase. The recording to verify the dimensions of the item correspond with the 
unit can contain a product lookup table to enable it to 55 selection made. However, such correspondence is very 
obtain weight and price information. When the cus- limited. As a result, as the Shapiro article points out, 
tomer wishes to check out, his/her collection of items is "Fruits and vegetables present considerable problems . 
weighed to verify that the actual total weight corre- • • an employee is stationed in the produce department 
spends with the total weight calculated by the elec- to weigh fruit and affix a coded label for the system to 
tronic recording unit. One important limitation of Eh- 60 read." The Johnson and Mergenthaler inventions pay 
rat's and Clyne's inventions is their poor ability to deal scant attention to user friendliness-an important consid- 
with products not having a machine readable code. eration for non-experienced users. The Humble inven- 
Another limitation is the risk of customer fraud if the tion pays more attention to user friendliness with the 
customer easily substitutes a more expensive item hav- incorporation of a touch-activated display screen, 
ing the same weight. 65 Nonetheless, as the Shapiro article notes, . . . "not deliv- 

Improved systems for automated: checkout are de- ered the promised labor savings . . . Check Robot says 
scribed in Mergenthaler U.S. Pat. No. 4,779,706, John- one cashier can handle three to eight lanes. But because 
son U.S. Pat. No. 4,787,467 and Humble U.S. Pat. No: of the need to help confused customers ... a cashier 
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assigned to every two lanes and other employees hover deter the customer from fraudulent activity. As well, a 
around the machines to help customers.** signal from the closed-circuit video camera showing the 

cttww * ™ ^ -T-TTT- T^rr^n^, areas containing the floor, the shopping cart and the flat 

SUMMARY OF THE INVENTION scanner area, is presented to the supervisory employee 

The present invention describes a method and appa- 5 via the supervisor module after payment is received, 
ratus which allows consumers to check out their pur- The supervisory employee must press a key on the 
chases with a minimal of direct human assistance. The supervisor module keyboard to accept the video image 
present invention possesses significant improvements (or avoid pressing a 'reject* button) to allow the com- 
with respect to the prior art in the areas of customer puter to allow the customer to remove his/her bags 
fraud, shopping efficiency, non -coded products and use 10 without the occurence of an audiovisual warning. Note 
by non-experienced users. that the present invention requires the supervisory em- 

The present invention consists of two major module- ployee to observe the video image for only a second 
s— the self-service unit utilized by the customer, herein unlike the constant monitoring that is required of typi- 
referred to as the 'robot module* and the unit utilized by cal video surveillance systems, 
the store employee to supervise the operations of sev- 15 Before the customer uses the robot module, he/she 
eral robot modules, herein referred to as the 'supervisor presses a button or switch indicating the level of experi- 
module*. The customer presents himself/herself at any ence he/she has with this type of automated point-of- 
available robot module with the items he/she has se- sale machine. For 'beginner* customers, when they have 
lected for purchase. The customer scans a product item an item not containing a machine readable bar code, as 
and then places it into a bag resting on a scale, herein 20 indicated by pressing a 'no bar code* button on the robot 
referred to as the 'packing scale*. The electronic signals module, they will be instructed to place the item di- 
from the scanner and the scale go to an electronic com- rectly into the bag on the packing scale where its image 
puter which contains (or can access) a product lookup (and/or possibly ultrasonic dimensions and/or dimen- 
table allowing the increase of weight on the packing sions obtained by breaking a light curtain above the 
scale to be verified against product number. The cus- 25 bag) is sent to the supervisor module. The supervisory 
tomer repeats this operation for all remaining items. If a employee receives a prompt to examine the image and 
weight change does not correspond with the product to enter the product number or a corresponding abbre- 
n umber then the customer will receive an audio and/or viation of the new item. In the case of the 'experienced' 
visual prompt to this effect from the robot module. customer, the computer monitor of the robot module 
Prompts typically are simultaneously transmitted to the 30 will present the customer with a menu selection in order 
supervisor module. A bidirectional intercom system for the customer to qualitatively identify the product 
allows the supervisory employee to immediately help and optionally identify its quantity. After identification, 
the customer with any difficulties and if necessary, via typically involving pressing a button corresponding to a 
the supervisor module keyboard, directly enter com- choice on a sub-menu, the customer is instructed to 
mands or product information. When the customer has 35 place the item in the bag on the packing scale. An image 
scanned and bagged all items selected for purchase, the of the bag's new contents along with the customer's 
customer goes to the supervisor module to pay, or if the identification are presented to the supervisory em- 
robot module is so equipped, as it would typically be in ployee via the supervisor module for verification. In the 
the case of debit or credit cards, the customer remains at case of both the 'beginner* and 'experienced' customers, 
the robot module for payment. In either case, the cus- 40 the weight change on the packing scale is evaluated by 
tomer is instructed to leave the bag on the packing scale the computer with reference to the product number 
alone. Removing the bag from the packing scale will ultimately chosen to see if the weight change is reason- 
cause a change in weight (or similarly, adding a non- able. If the weight increase differs by more than the 
scanned item to the bag will cause a change in weight) allowed tolerance for that product, then the supervisory 
that will be noticed by the computer and cause warning 45 employee will receive a prompt to inspect the transmit- 
to be given. Only after the computer receives a signal ted video image with more care. Note that with only a 
that payment has been received will it allow the bag small investment of the supervisory employee's time 
from the packing scale to be removed without a warn- and with little confusion to the inexperienced user, that 
ing prompt occurring. Note that the customer has nan- a product not bearing a machine readable code is accu- 
dled each item only one time. The customer scans and 50 rately identified. In particular, note that the customer is 
then directly bags the item. The item nor the bag is not not obligated to key in a series of product number digits 
handled again until checkout is finished, thus allowing a to identify the product 

high shopper efficiency. A small exception occurs if the As mentioned above, in the case of nonlabelled prod- 
customer has items too numerous to fit in the bag(s) on ucts, an image and possibly the dimensions of the prod- 
the packing scale in which case full bags are slid several 55 uct are transmitted to the supervisor module for ap- 
inches to an adjacent larger 'storage scale' where proval by the supervisory employee. For beginner cus- 
weight changes are monitored by the computer. tomers, the supervisory employee will actually identify 

To prevent the customer from scanning one item and the product and if necessary its quantity (i.e., enter the 
substituting a more expensive item into the bag on the product number or an abbreviation thereof and if neces- 
packing scale and to prevent the customer from placing 60 sary the quantity) while experienced customers are 
a nonscanned item into his/her bags after payment, the expected to identify the product typically through a 
present invention incorporates several innovative fea- series of menus displayed on a video display. Occasion- 
tures. The robot module is physically constructed to ally the customer will be expected to identify the quan- 
contain no openings nor any folds nor any flat surfaces, tity of the product as well, e.g., "4 apples." For the 
except the limited but prominent surface adjacent to the 65 experienced customer, the supervisory employee then 
scanner, where fraudulently substituted items could be will verify that the customer has correctly identified the 
discarded. The robot monitor contains a closed circuit product and its quantity. As mentioned above, the 
video camera and video monitor to psychologically weight of the product is nontheless evaluated by the 
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computer to make sure that the weight increase on the DESCRIPTION OF THE DRAWINGS 
packing scale corresponds reasonably with the product 

and its quantity. If poor correspondence is determined FIG. 1 is a perspective view showing the exterior 
by the computer, then the supervisory employee will be configuration of a preferred embodiment of the 'robot 
prompted to verify the transmitted, image with more 5 module' portion of the invention, 
care. Note that for both types of customers, and espe- F* 0 - 2 » a perspective view showing the exterior 
daily for. the experienced customer, only a small configuration of a preferred embodiment of the 'super- 
amount of the supervisory employee's time is required. visor module' of the invention 
The supervisory employee is not expected to constantly , n FIG. 3 is a block diagram of the invent.on. 
watch fvideo screen as is typically oone in cJose<ircuit 10 FIGS ^ flow-chart showing the logic steps 
television surveillance systeL Rather, the supervisory assoc,a,ed wth ,he wvcnt,on - 
employee receives the occasional prompt during a cus- DESCRIPTION OF THE PREFERRED 
tomer's order to look at the video screen for a moment EMBODIMENT 
for those products not bearing machine readable prod- 15 External Configuration 
uct codes. To maximize labor savings it is often advan- 
tageous to have one supervisory employee monitor as Turning now to FIGS. 1 and 2 there is shown a pre- 
many as eight robot modules. In such a case, should two ferred embodiment of the automatic POS machine, 
or more customers have nonlabelled products for verifi- 1 shows v the , P ort ' on ° f the nutchine used by the 
cation by the supervisory employee at the same time, » con f umer * chec !' 1 0 " t h,s/h ' r Phases. This portion 
assuming that the customers are experienced customers of * e , r^T,™ here ' n te referTe f d " as the robo ! 
and have identified the product, then it is useful after a ™°*? e ' 2 * ows * e P ort,on of ,' he machme ™* 

certain period of time has elapsed, e.g., 3 seconds, to * the , ? or < e , t0 J Upe ^ 6 *%T *t>°l 

* « . . * ' - several 'robot modules*. This portion of the machine 

verify the product soley on its weight. For die occa- „ ^ ^ ^ n{ened t<) as £ . isor module , 

sional time when the supervisory employee is busy, this ^ 2 d jcts a $ ervisor moduIe which is ble of 

scheme maintains shopper efficiency without reducing s isin tw0 robot modules . 

overall security very much. It is possible to extend this 

scheme even further to maximize labor savings even Robot Module 
more. By using additional sensory modalities in con- 30 The robot module, as shown in FIG. 1, instructs the 
junction with the transmitted video images, it is possible consumer via a centrally located video display terminal 
to have one supervisory employee monitor more robot u Xo communicate with the robot module, the con- 
module without reducing shopper efficiency or overall sumer can press buttons 1 through 10. In the embodi- 
security. By determining the dimensions of the product men t shown here the video display terminal would 
being placed into the bags on the packing scale, for the 35 typically be a high resolution color graphical video 
majority of nonlabelled products it will be sufficient to display terminal and the buttons would be color coded 
verify the dimensions and the weight of the product switches. The buttons would be lined up precisely with 
against its product code information to assure that the the video display terminal 11 so that they could be used 
experienced customer is accurately and honestly identi- for many different functions. In other embodiments, the 
fying the product. Only for those cases where the com- labelling or the quantity of the buttons could differ from 
puter has determined that the correspondence of mea- the present embodiment. As well the video display 
sured dimensions and measured weight is poor, will it terminal could be monochrome rather than color, and 
be necessary to use the supervisory employee's time to its size and location could differ from the present em- 
examine the transmitted image to make a final decision. 45 bodiment. It is possible, in a different embodiment of the 
Two methods of determining dimensions are readily present invention, to replace or supplement the combi- 
available for use with the robot module. One method nation of buttons 1 to 10 and the video display terminal 
consists of placing in proximity to the packing scale a u > with a touch-sensitive video display terminal. Other 
three-dimensional array of light beams and light detec- embodiments of the present invention are also possible 
tors. The dimensions of the customer's hand holding the 50 whereby the buttons 1 to 10 are replaced by other 
product and the dimensions of the customer's empty means of user intcrfa «' e.g voice recognition cir- 
hand returning from the packing scale can be easily CUItr * tnterruption of beams of light by a pointing fin- 
computed by the computer by following which light ge ^ oyst ? c 7 e ' ... * 
. r , , , » i*. ■ m. The robot module also instructs the consumer via a 
beams have been interrupted. Thus, by subtracting the mnXr ~ «, c „ t n _ • fo rtf „„ 0 rt „ 
■ , , _ - ' ,. . 0 . «< speaker system 12. Speaker system 12 consists of one or 
dimensions of the empty hand from the dimensions of ^ audjo ^ %Q Qn&Ql mQTe ^ 

the hand plus product, net dimensions of the product w ^ ^ speaker system 12 rcce ives computer 
can be calculated. Another method of determining di- gcne rated voice signals and computer generated tonali- 
mensions involves placing ultrasonic transducers above tics from the ^ of the automatic POS 
the packing scale. The ultrasonic transducers and ap- w M chine. Speaker system 12 also receives speech signals 
propriate circuitry can measure the distance from their from thc m i crop hone 61 at the supervisor module. Like- 
fixed position to the top of the contents in the packing y^ stf tne consumer can communicate by voice with the 
scale bag(s). Thus, by observing the change in distances employee supervising the automatic POS machine via 
from the ultrasonic transducers to the tops of the con- microphone 13. Note that in the present embodiment 
tents in the packing scale bag(s), the computer can cal- 55 microphone 13 attaches to the robot module via a flexi- 
culate net volume changes. This net measured volume ble neck 161. 

can then be verified against the product number's stored Sign 141 provides the consumer with information 

volume limits. regarding the operation of the automatic POS machine, 
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as well as advertising for services and products offered item the customer places on platforms 22 or 28 will 
by the store. cause a weight change to be detected by the packing 

Laser scanner 14 is capable of interpreting a bar scale 23 or the storage scale 29. If the item has not been 
coded label on a retail product Bar coded labels, as one scanned, the machine will prompt the customer to re- 
skilled in the art knows, represent digits and occasion- 5 move the item, as discussed later below. If the customer 
ally alphanumeric symbols, by a series of thin and thick leaves an item on the laser scanner 14 or on the surface 
bars. Many products sold at retail stores posses a bar 16 adjacent to the laser scanner, the supervisory em- 
coded label representing the manufacturer's product ployee will be able to see these items via the video 
number for that product. Laser scanners are commer- image recorded by camera 32. 

cially available which scan with a moving laser beam 10 The surface 16 adjacent to the laser scanner 14 is a 
the bar coded label on a product and produce an electri- useful feature of the present invention. Surface 16 al- 
cal signal representing that product's code number. An lows the customer to place a shopping basket IS adja- 
area 16 prior to the laser scanner allows consumers to cent to the laser scanner 14. In the case whereby the 
prepare products for scanning. In FIG. 1, a shopping customer uses a shopping cart, surface 16 serves as a 
basket 15 is shown resting on area 16. 15 small area where the customer can unload items from 

After a consumer scans a purchased item over the the shopping cart before deciding exactly which items 
laser scanner 14, the consumer places the item into the should be scanned first 

plastic or paper bag 21 held in place by bag holders 19 A key feature of the present invention is the proxim- 
and 20. Bag holders 19 and 20, as well as portions of bag ity of the laser scanner 14 to the packing scale 23. This 
21, lie on platform 22. Platform 22 lies on a weighing 20 proximity allows the customer to scan and then bag an 
scale 23, herein referred to as the 'packing scale*. item in one single step. 

For the sake of simplicity, in the embodiment being , 
discussed here, 18 is considered to be a sensor transmit- Supervisor Module 

ting only images of the contents of bag 21 to the super- The supervisor module, as shown in FIG. 2, allows a 
visor module. Thus, in the embodiment being discussed 25 store employee to supervise the operation of the robot 
here, sensor 18 will be referred to also as 'sensor/video module of FIG. 1. Together, FIG. 1 and 2, i.e., the 
camera* 18.. However, as mentioned above, sensor 18 robot module and the supervisor module, constitute an 
may in other embodiments contain a three-dimensional embodiment of the present invention. As mentioned 
array of light beams and detectors which measure the above, the present embodiment depicts a supervisor 
dimensions of the customer's hand and product going to 30 module which is capable of supervising two different 
the bag 21 and the customer's empty hand returning robot modules. However, other embodiments can be 
from bag 21 thus allowing computation of the net di- envisioned which allow the store employee to supervise 
mensions of the product. Sensor 18 may also contain an greater number of robot modules, 
plane of ultrasonic transducers which measure the dis- Since the supervisor module shown in FIG. 2 is in- 
tance from the fixed position of sensor 18 to the top of 35 tended to supervise the operation of two robot modules, 
the contents of the bag 21. By noting the change in these the present embodiment of the supervisor module con- 
distances after a product is placed is bag 21, it is possible tains two of all parts. An exception is that it contains 
to compute the volume of the product. Other embodi- only one microphone 61 which must be shared between 
ments of the present invention are thus possible where two robot modules via microphone switch buttons 62 
sensor 18 consists of a video camera and/or a light- 40 and 63. From the point view of reliability there are 
beam dimension computing array and/or an ultrasonic advantages to keeping the supervisory equipment re- 
transducer volume computing plane. quired for the each of the two robots separate. For 
After bag 21 is full, it can be transferred by the con- example, if one set of supervisory equipment fails, then 
sumer to platform 28. In FIG. 1, such a bag 24 is shown only one robot will be inoperable since the other set of 
resting on platform 28. Note also that platform 28 con- 45 supervisory equipment is working. However, for rea- 
tains a pole 26 which in turn contains hooks 27. Addi- sons of economy, it is possible to envision other embodi- 
tional bags can be hung on hooks 27. Platform 28 lies on ments of the supervisor module which share many su- 
a weighing scale 29, herein referred to as the 'storage pervisor components to supervise the operations of 
scale'. many robot modules. 

Pole 30 is attached to the cabinet 162 of the robot 50 Since the supervisor module contains two sets of 
module (it does not make any contact whatsoever with symmetrical components, we shall arbitrarily decide to 
platform 28). Mounted on the top of pole 30 is a surveil- consider the components on the left-hand side of the 
lance camera 32 and a surveillance monitor 31. Surveil- page as being the components which connect with the 
lance camera 32 transmits video images of the consumer particular robot module shown in FIG, 1. 
and the immediate region around the consumer. These 55 Video monitor 51 displays the video images transmit- 
images are sent to the supervisor module as well as ted by video cameras 18 and/or 32. Video monitor 
being displayed on the surveillance monitor 31. Thus, switch 60 controls whether the monitor displays the 
the consumer can see images of himself/herself on mon- image from sensor/video camera 18 and/or the image 
itor 31 and thus is aware that his/her actions are being from video camera 32. As is apparent from FIG. 1, 
monitored by the supervisor employee. 60 sensor/video camera 18 allows the supervisory em- 

Cabinet 162 and cabinet 17 of the robot module do ployee to see the contents of the sac 21 on the packing 
not have openings. As well, platforms 22 and 28 occupy scale 23. Similarly, video camera 32 allows the supervi- 
most of the horizontal space over cabinet 162. An im- sory employee to see the actions of the consumer and 
portant feature of the present invention is that it is diffi- the area immediately around the consumer, 
cult for a customer to leave aside an item he/she does 65 Video display terminal 53 generally displays the same 
hot scan so as to avoid paying for the item by simply information shown on video display terminal 11. Thus, 
bagging the item when the order is completed and he/- the supervisory employee can see what actions the con- 
she is taking the bags from platforms 22 and 28. Any sumer is being instructed to perform at that moment, as 
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well as the summary information about the order (e.g., skilled in the art is aware that other means of paying for 
total cost, items purchased etc) normally displayed to purchases are in commercial existence. These means 
the consumer. Occasionally, video display terminal 53 include cheques, credit cards, debit cards, store vouch- 
may contain information not shown on video display ers, and store cards. Apparatus to process such means of 
terminal 11; generally this is information required by the 5 payment, as well as apparatus that automatically reads 
supervisory employee but not by the consumer, e.g., an legal currency and provides coin change, is commer- 
acceptable weight tolerance for a certain product. In cially available and can be built into the robot module of 
other embodiments of the present invention whereby it FIG. 1 to allow the consumer to automatically pay for 
is desired to economize as much as possible on compo- his/her order. For examine, a commercially available 
nents required for the supervisor module, video display 10 credit card reader apparatus could be attached to pole 
terminal 53, as well as video monitor 51, would contain 30. The consumer would place his/her credit card in 
alternating or reduced sire or summarized images and such apparatus at the end of the order to pay for the 
information from several different robot modules. order without any assistance by the human supervisory 

Microphone 61 allows the supervisory employee to employee. Similarly, it is possible to envision a commer- 
talk with the consumer. Note that in the present em- 15 ciafly available currency reader to be attached to pole 
bodiment of the invention, there is only one microphone 30 to allow the consumer to pay for the order with cash 
for the two robots served by the supervisory module. without any assistance by the human supervisory em- 
The supervisory employee must press microphone ployee. 

switch 62 on the supervisor keyboard 57 to transmit a . , n ^ . t - 

message to the speaker system 12 of the specific robot 20 Functional Description 

module shown in FIG. 1. Turning now to FIG. 3, there is shown a block dia- 

Receipt printer 55 prints a receipt for the consumer. gram corresponding to preferred embodiment of the 
If a seperate receipt printer is used for each robot, as automatic POS machine shown in FIGS. 1 and 2. The 
shown in the present embodiment, then every time the components of the robot module and the components of 
consumer scans an item and places it in sac 21, it makes 25 the supervisor module (i.e., the portion of the supervi- 
sense to print out the item purchased and its price. sor module devoted to that robot) arc connected by a 
When the consumer has . finished his/her order, the cable 140. In the preferred embodiment, cable 140 is 
reciept will have already largely been completed thus composed of video cable capable of transmitting higher 
saving time. As well, if there are any problems during bandwidth video signals, lower capacity audio cable 
the order, the operator can examine the receipt to very 30 and data communication cable for transmitting the data 
quickly see what items have been purchased (although processing signals to and from the communication ports 
the latter information is also generally available via the 109 and the keyboard encoder 122. 
video display terminal 53). Receipt printers, as one Note that FIG. 3 is composed of three largely inde- 
skiUed in the art knows, are available commercially pendent systems. These can be considered as the 'video 
from many different manufacturers with many different 35 system^ the 'audio system* and the 'information system', 
features. Some receipt printers have the ability to print The 'video system* of the robot module consists of 
in color, while others may have the ability to print bar the color sensor/video camera 18, the black and white 
coded coupons. In general, receipt printers print a 40 surveillance video camera 32, the black and white video 
column or narrower receipt for the consumer, as op- monitor 31 which displays the image from camera 32. 
posed to the 80 or 132 column printers used by many 40 (If in another embodiment sensor 18 consists of dimen- 
data processing systems. sional measuring and volume measuring sensors as well 

Operator keyboard 57 consists of a group of buttons as a video camera, then please note that only the video 
which the supervisory employee uses to control the camera portion would be part of the 'video system*. The 
robot. For example, if a product which has no bar dimensional and volume measuring sensors would inter- 
coded label is placed, in sac 21, then the supervisory 45 face with the 'information system*.) Signals from the 
employee may be expected to enter a code and/or ap- color camera 18 and the surveillance camera 32 are sent 
prove the item via the operator keyboard 57. Other to the supervisor module. At the supervisor module, 
embodiments of the present invention are also possible monitor switch 60 allows the supervisory employee to 
whereby the operator keyboard 57 is replaced by other decide whether to display on video monitor 51 the 
means of. user interface, e.g., voice recognition cir- 50 image from the camera 18 and/or the image from the 
cuitry, interruption of beams of light by a pointing fin- surveillance camera 32. One purpose of the 'video sys- 
ger, joystick, etc. tern' is to allow the supervisory employee to see what 

Cash drawer 64 is metal cash drawer which can be items are being placed in the sac 21 on the packing scale 
opened by the computer in cabinet 66 of the supervisory 23. Occasionally items may not have a bar coded label 
module. For example, if a consumer intends to pay in 55 and the supervisory employee may be expected to enter 
cash and his/her order is finished, then the consumer a code or to a approve a product number chosen by the 
would walk over the supervisory module and give the consumer. As well, it is useful for the supervisory em- 
supervisory employee cash. The supervisory employee ployee to occasionally check if the contents of the bag 
would enter the amount of cash into the computer via correspond with the products scanned (in addition to 
the operator keyboard 57. The computer would then 60 the automatic weight checking that the machine per- 
open the cash drawer 64 to deposit the payment and to forms for all products). Another purpose of the 'video 
make change, if necessary, for the consumer. In the system* is to allow the supervisory employee to see 
embodiment of the present invention shown in FIG. 2, what the consumer is doing. If the consumer requires 
a separate cash drawer is used for each robot that the assistance and speaks to the supervisory employee via 
supervisor modules supervises. However, one can also 65 the microphone 13, the supervisory employee will be 
produce an embodiment of the present invention better able to aid the consumer since the employee can 
whereby one cash drawer is shared by several robots. see via video monitor 51 what the consumer is doing 
Similarly, although not shown in FIGS. 1 or 2, one right or wrong. Another purpose of the 'video system' 
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is to psychologically deter the consumer from trying to advances in technology, as one skilled in the art is 
fraudulently defraud the machine. By displaying the aware, algorithms controlling CPU's are largely kept 
video image of the consumer on video monitor 31 lo- on magnetic disk (occasionally tape) drives. By keeping 
cated in the robot module, the consumer is constantly algorithms stored on magnetic disk drives, future modi- 
reminded that his/her actions are being monitored and 5 fication becomes simple as it is easy to read and write 
thus is less likely to try to defraud the machine. programs from and to magnetic disk drives. As well, 
The 'audio system* of the robot module consists of due to advances in technology, many of the algorithms 
microphone 13 which attaches to preamplifier 101, and for controlling what is often described as the Mow-level 
speaker system 12 driven by audio amplifiers 102, 103, functions', i.e., the creation and movement of the data 
and 104. The 'audio system' of the supervisor module 10 communication signals, are commercially available 
consists of microphone 61 which attaches to micro- from numerous sources. In the present invention, it 
phone switch 62 which attaches to preamplifier 127 and would seem that the algorithm, or program, controlling 
speaker system 126 which is driven by audio amplifiers the operation of CPU 120 is somewhat removed from 
123, 124, and 125. One purpose of the 'audio system* is the physical basis of the invention. However, in reality, 
to allow two way audio communication between the 15 it is simply that current technology makes it economi- 
consumer and the supervisory employee. The consumer cally advantageous to use several layers of algorithms, 
can ask questions, for example, via microphone 13 whereby the lower layers are inexpensive, genetically 
which attaches to preamplifier 101 and whose signal is available algorithms. 

reproduced by speaker system 126 of the supervisor Although, as mentioned above, the 'video system', 

module. The supervisory employee can respond to 20 the 'audio system' and the 'information system* are 

questions via microphone 61 which is switched to a largely independent, the 'information system* does in 

particular robot module via switch 62 and which then fact send audio signals to the 'audio system'. CPU 120 

attaches to preamplifier 127 whose signal is reproduced can instruct tone circuit 116 to produce various tones, 

by speaker system 12 of the robot module. Speaker e.g., beeps, thuds, alarm tones, which are then sent to 

systems 12 and 126 also receive and reproduce digitized 23 the speaker system 126 in the supervisor module and the 

voice and tonality signals from the 'information system*. speaker system 12 in the robot module. Similarly CPU 

For example, if the 'information system' wants the user 120 can instruct the voice digitizer circuit 121 to recon- 

to place sac 21 on the storage scale 29, the 'information struct various digitized words or phrases, whose digital 

system*, via the voice digitizer circuit 121 will send a representations are currently in RAM 119, and to send 

human sounding voice to the robot module and the 30 the reconstructed audio signal to the speaker system 126 

supervisor module speaker systems 12 and 126. This in the supervisor module and speaker system 12 in the 

voice would instruct the consumer, for example, to robot module. 

place sac 21 on storage scale 29. For example, if the CPU 120 can instruct the graphical processing cir- 
consumer presses an incorrect button, the 'information cuitry 132 to display characters representing prices, 
system' may send a thudding tonality signal via the tone 35 product descriptions, etc, in various colors, on the su- 
circuit 116 to speaker systems 12 and 126. pervisor module's video display terminal 53 and simul- 
The remainder of the components shown in FIG. 3 taneously on the robot module's video display terminal 
can be taken to make up the 'information system'. The 11. CPU 120 can also instruct the graphical processing 
'information system* is controlled by the CPU (Central- circuitry 132 to reconstruct various digitized video 
Processing-Unit) 120. Many powerful, compact and yet 40 images, whose digital representations are currently in 
economical CPU's are commercially available. As one RAM 119, and to display these images on video display 
skilled in the art recognizes, CPU 120 can retrieve com- terminals 53 and 11. Such images can consist of illustra- 
puter programs from magnetic disk drive 118 and from tions showing the customer how to use the machine, eg, 
ROM (read-only-memory) program memory 117. Mag- scanning products, placing products in the bags, press- 
netic disk drive 118 is also used to store information 45 ing buttons, etc; images corresponding to products 
such as product codes of the store's inventory, prices, being scanned or those which the customer must select 
other product specific information, images of products, from; images consisting of characters in fonts which are 
images intended to help the user use the machine, and generally larger than is usual for characters to be dis- 
digitized representations of various words and phrases. played on video display terminals. 
For timely operations, it is advantageous for CPU 120 50 The customer can communicate with the 'informa- 
to process data stored temporarily in the RAM (ran- tion system* via buttons (generally momentary contact 
dom-access-memory) 119. As one skilled in the art switches) 1 to 10, strategically located around the video 
knows, it is possible to construct CPU 120, RAM 119, display terminal 11. For example, if a product does not 
and program and data storage circuit equivalent to have bar coded product code, it is necessary for the 
magnetic disk drive 118 and ROM 117, from discrete 55 customer to press one of the above buttons to indicate 
transistors, resistors, capacitors and interconnecting this to the 'information system'. Similarly, the super vi- 
wires. However, advances in technology have allowed sory employee can communicate with the 'information 
the thousands of transistors required for an appropriate system* via the supervisor keyboard 57. For example, if 
CPU 120, an appropriate RAM 119, an appropriate the supervisory employee must visually approve a prod- 
ROM 117 and an appropriate magnetic disk drive 118 to 60 uct which docs not have a bar coded product code, then 
be placed on a relatively small amount of integrated he/she will have to press an appropriate button on the 
circuits. Advances in technology have also allowed one supervisor keyboard 57. Buttons 1 to 10 and the superi- 
or two small rotating rigid magnetic platters to form the sor keyboard 57 attach directly, or send an encoded 
mechanical basis for an appropriate magnetic disk drive data signal, to keyboard encoder 122. Keyboard en- 
118. As one skilled in the art knows, the algorithm 65 coder 122 transforms the signals from buttons 1 to 10 
which controls the CPU 120 can be implemented with and from the supervisor keyboard 57 into data signals 
discrete transistors, resistors, capacitors or can be im- compatible with CPU 120, to which the keyboard en- 
plemented entirely in the ROM 117. However, due to coder 122 is attached. 
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CPU 120 communicates with modem 108, the laser changed by the centra) computer system via appropri- 
scanner 14, the packing scale 23, the storage scale 29, ate commands to the CPU 120 via modem 108. 
the government regulated weight display 105, the lane . . n . . 

status lamp 106, the receipt printer 55 and the cash uescn P uon 
drawer 64 via the communication ports circuitry i09 5 FIG. 4 is a flow-chart describing the overall function 
and respectively individual communication ports 110, of the 'information system* of the present invention. As 
111, 112, 113, 114, and 115. Note that in the shown mentioned above, current technology makes it econom- 
configuration communication port 114 sends signals to ically advantageous to use several layers of algorithms, 
relay board 107 which in turn controls the weight dis- whereby the lower layers are inexpensive, generically 
play 105 and the lane status lamp 106. Note also that in W available algorithms. The high-level algorithm shown 
the shown configuration, communication port 115 com- FIG. 4 along with textual discussion of this algorithm 
municates indirectly with the cash drawer 64 via the » sufficient to allow one skilled in the art to construct a 
receipt printer 55. If the receipt printer 55 receives a working automatic point-of-sale machine. One skilled in 
predetermined unique string of characters), then it will ^ t0 construct a working automatic point-of-sale ma- 
in turn send a signal to cash drawer 64 causing it to 13 chine * ° ne skilled in the wQ1 ^ so realise that the 
C p Cn w algorithm shown in FIG. 4 is only one of many possible 

The functions of laser scanner 14, packing scale 23 algorithms which could be used to control the function 
and storage scale 29 have been discussed above. Laser of automatic point-of-sale machine, 
scanner 14 will read a bar coded label placed in the path , u . ^fcrrag now to Section A of FIG. 4, this shows the 
of its laser beam and will convert the information con- 20 *^**™^ 9 Md 15 *™ TO *™^ °* ed the 
veyed by the bar coded label into a representation of the Mam AlgonUnn When power is applied to he auto- 
product code which can be sent to the CPU 120 via port mat,c Pf^of-sde machme and hence to the informa- 
ill. Packing scale 23. will convert the weight of the tlon **** of the ^ m ^ on * m y c ° m ' 

products placed on its weighing platform 22 into a data menccs ^ lth ™ ^tialization routine. The untiahration 
p : u- t u ♦ I 1 JJJdti m 1 in 25 routine, like all the routines shown in FIG. 4, is actually 
signal which can be sent to the CPU 120 via port 112. . ' ... . , ... , . , ■ ' « iXt . 

Jr ' s . . . . . . . , m . r _ an algorithm. This algorithm is a layer below the 'Main 

Note that paclang scale 23 sends a signal to the govern- J md itself makes use of other algorithms on 
men regulated weight display 105. In many localities, ^ cvcn lowcr ^ ^ $Q Qn ^ ^ } Qf 
the law requires that customers be shown the weight J rilhms are those that sent ^ receive Vs md 0 's 
registered by a scale which is to be used to weigh prod- 3Q ff * m ^ cpu m Qnl ^ w h , cvd ^ rithms m 
ucts whose price is determined by weight. In cases shown fa FIQ 4 since of the , ower Jevel ^ 
where the customer is not required to see the actual ri thms are common, commercially available algorithms, 
weight on the scale, or if thewejghtis shown instead on or simple variants which one skilled m ^ art 

video display terminal 11, CPU 120 is able to turn of! wou , d ^ mdy be familiar with. The initialization rou- 
the government regulated weight display via port 114 35 tine wouId ty p ica) iy ca i| ot her algorithms to initialize 
and relay board 107. CPU 120 is also able to turn on and the communication port circuitry 109, to transfer files 
off, via port 114 and relay board 107, lane status lamp hom the magnetic disk drive 118 to RAM 119, etc. 
106. Lane status lamp 106 is an optional feature not After initialization, the video display terminal 11 
shown m FIG. 1. Lane status lamp 106 is a lamp which display a graphical message to the customer to press any 
is generally mounted on pole 30 or on top of camera 18 40 bimo n to begin checkout of one's order. The CPU 120 
and indicates to customers that the lane is available for is instructed to wait for a button 1 to 10 to be pressed. If 
service. Although not shown in the present configura- a customer wishes to use the automatic point-of-sale 
tion, it would be possible to include several such lamps machine, then he/she will press any button to com- 
and place them on top the storage scale 29, the packing me nce operations. At this point the algorithm instructs 
scale 23 and other locations to help the customer use the 45 the CPU 120 to collect various information from the 
machine properly. For example, when the customer customer. One useful piece of information is whether 
was to move sac 21 from the packing scale to the stor- th e customer has used this machine previously or if 
age scale 29, the CPU 120 could cause a lamp mounted he/she is a beginner. The next step is to prompt the 
on the storage scale to turn on so as to prompt the . customer, via digitized images on the video display 
customer. 50 terminal 11 and via digitized human-sounding voice 

Modem 108 allows the 'information system* to com- phrases from speaker system 12, to place a bag in the 
municate with other computer systems. Modem 108 bag holders 19 and 20. This prompting algorithm would 
attaches to CPU 120 via communication port 110 and then have the user press a button to indicate that the bag 
communication circuitry 109. As one skilled in the art is is in place. 

aware, numerous commercially available modems exist 55 The 'Main Algorithm* now checks three conditions 
which transmit data signals over ordinary phone wires, (each, of course, composed of numerous sub-condi- 
over specialized phone wires, over local computer net- tions): Has an unauthorized weight change occurred on 
works, asynchronously, synchronously, to microcom- packing scale 23 or on the storage scale 29? Has the 
puters, to minicomputers and to mainframe computers. laser scanner 14 read a bar code? Has the user pressed 
A typical use of present invention will be to have nu- 60 any button 1 to 10 or has the supervisory employee 
merous robot-supervisor, modules report to a central- pressed any key on the supervisor keyboard 57. 
ized computer system. In such a case, the modem 108 Let us consider the case whereby the customer tries 
would transmit inventory changes to the central com- to steal an item by placing it directly into sac 21 without 
puter system. In such a system the central computer scanning it first. When the 'Main Algorithm' checks to 
system would transmit price changes and new product 65 see if an unauthorized weight change has occurred, it 
information to the CPU 120 via the modem 108. As calls lower algorithms which provide the current 
well, changes in the computer program controlling the weight on the packing scale 23 and on the storage scale 
CPU 120 stored on magnetic disk drive 118 could be 29. If the current weight on a particular scale differs by 
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greater than a predetermined error margin, then weight 
has been added to or removed from the scale, which- 
ever the case may be. Thus, the 'Main Algorithm* will 
consider the condition of whether an unauthorized 
weight change to have occurred to be true and will as 5 
shown transfer control to the Weight Change Algo- 
rithm'. Section B of FIG. 4 is a flow-chart of the 
'Weight Change Algorithm'. In the above case where 
the customer placed an object into the sac 21 without 
scanning it in an attempt to avoid paying for the item, 10 
the 'Main Algorithm' would have determined that un- 
authorized weight had been added to the packing scale 
23. Thus the 'Weight Change Algorithm* would display 
an appropriate digitized video image on the video dis- 
play terminal 11 and play an appropriated digitized 15 
human audio message from speaker system 12 prompt- 
ing the customer to remove the hern from the sac 21. At 
the end of the prompt, the 'Weight Change Algorithm' 
checks to see if the weight on the packing scale 23 is 
back to the previous weight, i.e., has the item been 20 
removed. If it is back to the previous weight then the 
•Weight Change Algorithm' ends and control is trans- 
ferred back to point 'B' on the 'Main Algorithm'. If the 
weight has not returned back to the previous value, or 
if the customer has tried to remove a different item 25 
resulting in a lower weight but one not equal to the 
previous value, then the visual and audio prompt is 
repeated. Note that supervisory employee can press a 
button on the supervisor keyboard 57 to leave the 
'Weight Change Algorithm* and return back to point 30 
'B* on the 'Main Algorithm'. 

Let us assume that the customer has taken out of the 
sac 21 the item in question in the above case. Thus 
control has passed back to the 'Main Algorithm' where 
the latter is continually examining whether an unautho- 35 
rized weight change has occurred, whether a bar code 
has been scanned or whether a key has been pressed. 
Now let's assume that the customer scans the item over 
the laser scanner 14 and then places the item in the sac 
21. The laser scanner 14 will convert the bar code into 40 
the corresponding product code and send this code via 
the port 111 and the communication port circutry 109 
to the CPU 120. Thus the condition 'Scan Received' 
will become true and thus, as shown in FIG. 4 control 
will go to the 'Scan Algorithm'. 45 

Section C of FIG. 4 is a flow-chart of the 'Scan Algo- 
rithm*. The 'Scan Algorithm' first takes the product 
code and looks up information for this product code. 
Lower level algorithms are used to maintain a database 
of all product items and to allow quick retrieval from 50 
such a database. The product information for a given 
product code would typically consist of price, descrip- 
tion, weight, weight tolerances to accept, tax informa- 
tion, inventory information, and discount information. 
The 'Scan Algorithm' then calls an algorithm which 55 
waits for an increase in weight on the packing scale 23. 
When this weight increase has occured and the weight 
reading from scale 23 is considered stable, the 'Scan 
Algorithm' considers the condition of whether the 
weight increase on packing scale 23 is within the weight 60 
range specified by the product information for that 
product. If the weight increase is considered within 
range, then the 'Scan Algorithm' goes to the next step 
where it causes receipt printer 55 to add the product to 
the receipt. The product description and price, as well 65 
as the current total price of the order is displayed on the 
video display terminal 11 (as well as video display ter- 
minal 53). The 'Scan Algorithm' then ends and control 
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is transferred back to point *B* on the 'Main Algorithm'. 
If, on the other hand, the weight increase is not within 
the specified range, the 'Scan Algorithm' will transfer 
control to the 'Weight Change Algorithm'. As de- 
scribed above, the 'Weight Change Algorithm* will 
prompt the user to remove the item from the grocery 
sac. 

Let us assume that control has passed back to the 
'Main Algorithm' where the latter is continually exam- 
ining whether an unauthorized weight change has oc- 
cured, whether a bar code has been scanned or whether 
a key has been pressed. Now let's assume that the cus- 
tomer has an item which has no bar code label. When 
the 'Main Algorithm* is continually examining whether 
an unauthorized weight change has occured, whether a 
bar code has been scanned or whether a key has been 
pressed, it displays on the video display terminal 11 ten 
arrows pointing to the ten buttons 1 to 10. Each arrow 
is labelled. For example, let us consider an embodiment 
of the present invention whereby the arrow to button 1 
is labelled 'HELP', the arrow to button 2 is labelled 
'NO BAR CODE', the arrow to button 3 is labelled 
'CHANGE BAG', the arrow to button 4 is labelled 
'END ORDER', the arrow to button 5 is labelled 
'COUPON' and that the arrows to buttons 6 to 10 are 
not labelled. The customer will thus press button 2, 
which corresponds to the label 'NO BAR CODE' on 
the video display terminal 11. The customer then places 
the item in sac 21. 

The condition 'Key Pressed* will become true after 
the customer presses button 2 ('NO BAR CODE'). 
Thus, control will pass from the 'Main Algorithm* to 
the 'Key Press Algorithm'. Section D of FIG. 4 is a 
flow-chart of the 'Key Press Algorithm'. As shown in 
this figure, since the condition 'No Bar Code Key 
Pressed' is tnie, the 'Key Press Algorithm' calls the 'No 
Code Algorithm*. In the case of a user using the auto- 
matic point-of-sale machine for one of his/her first 
times, the 'No Code Algorithm' alerts the supervisory 
employee with a visual message on video display termi- 
nal 53 and an audio message from speaker system 126 
that an item having no bar code has been placed in sac 
21. The supervisory employee will examine the video 
image of sac 21 transmitted by camera 18 and displayed 
on video monitor 51 and via the supervisor keyboard 57 
key in the product code or a product description which 
will allow a lower-level algorithm to use to determine 
the product code. In the case of an experienced cus- 
tomer, the 'No Code Algorithm' will present the cus- 
tomer with a menu of choices. Such a menu consists of 
a graphical image displayed on video display terminal 
11 consisting of ten arrow pointing to the ten buttons 1 
to 10, each with a label of product choice or another 
sub-menu to choose from. After the customer has 
chosen the product, the supervisory employee is 
prompted to examine the video image of the sac 21 
transmitted by camera 18 to video monitor 51 and to 
approve or reject the choice. If the customer made a 
mistake or intentionally chose a cheaper product, the 
rejection by the supervisory employee will cause the 
'No Code Algorithm' to start over again. In any case, 
when the 'No Code Algorithm' is successfully com- 
pleted, control transfers back to point 4 B' on the 'Main 
Algorithm*. 

Let us consider the other buttons which the customer 
can press. As mentioned above, let us consider an em- 
bodiment of the present invention whereby the arrow to 
button 1 is labelled 'HELP', the arrow to button 2 is 
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labelled 'NO BAR CODE*, the arrow to button 3 is dally available currency readers for automatic cash 
labelled 'CHANGE BAG', the arrow to button 4 is payment. In the typical embodiment, after the supervi- 
labelled 'END ORDER', the arrow to button 5 is la- sory employee has received payment, the customer is 
belled 'COUPON* and that the arrows to burtons 6 to given the receipt for the order. If a cash payment was 
10 are not labelled. If button 1 ('HELP*) is pressed then 5 made then the 'End Order Algorithm* will instruct the 
control is transferred to the 'Key Press Algorithm* port 115 to signal the receipt printer 55 to open the cash 
which in turn calls the 'Help Algorithm*. The 'Help drawer 64. The 'End Order Algorithm* then makes sure 
Algorithm* alerts the supervisory employee and that there have been no unauthorized weight changes 
prompts the customer to speak into microphone 13. on packing scale 23 or storage scale 29. The customer is . 
Microphones 13 and 61 and speaker systems 12 and 126 10 now free to remove his/her bags from the packing scale 
allow the customer and the supervisory employee to 23 and the storage scale 29. Note that when the 'End 
carry on a two-way conversation. As well, the supervi- Order Algorithm* finishes, control returns to point 'A* 
sory employee can press the monitor switch 60 to dis- on the *Main Algorithm*, i.e. the automatic point-of-sale 
play the image from camera 32 on video monitor 51 machine waits for the next order, 
which is the video image of the customer and his/her 15 Let us now consider the case of pressing the 'COU- 
immediate surroundings. Section D of FIG. 4 shows PON* button 5. When the customer has a discount cou- 
that after the 'Help Algorithm* is finished, control re- pon for a particular product or perhaps a general credit 
turns to point 'B* on the 'Main Algorithm*. This is the voucher he/she should press the 'COUPON* button 5. 
general case, although not shown is the possibility for Control is transferred from the *Main Algorithm* to the 
the supervisory employee to branch to different parts of 20 'Key Press Algorithm* and in turn to 'Coupon Algo- 
the 'Main Algorithm* as well as various lower level rithm*. In the case of a user using the automatic point- 
algorithms, of-sale machine for one of his/her first times, the *Cou- 
We have already considered the case of pressing the pon Algorithm* will simply have the receipt printer 55 
'NO BAR CODE' button 2. Let us now consider the print a short note or a symbol that will alert the cashier 
case of pressing the 'CHANGE BAG* button 3. If the 25 at the time of payment that there is a credit adjustment 
customer has a large order requiring several bags, then to be made. In the case of a more experienced user, the 
when the customer wants to use a new bag, he/she 'Coupon Algorithm* will prompt the user to enter the 
should press the 'CHANGE BAG* button 3. Control is amount of the coupon or voucher via a human sounding 
transferred from the 'Main Algorithm* to the 'Key Press voice from speaker system 12 and via a graphical mes- 
Algorithm* and in turn to the 'Change Bag Algorithm*. 30 sage displayed on the video display terminal 11. The 
The 'Change Bag Algorithm' prompts the customer to image on the video display terminal 11 will consist of 
transfer bag 21 to platform 28 or the hooks 27 on the the arrows pointing to the ten buttons 1 to 10 labelled '1* 
platform 28 of the storage scale 29. The customer is to '10' so that the customer is able to use buttons 1 to 10 
prompted via a digitized video image on the video dis- to enter the monetary amount of the coupon or the 
play terminal 11 and via a digitized human-sounding 35 voucher. In the future, coupons that have bar codes on 
voice from the speaker system 12. The customer is them will become more widespread. For the case of 
asked to transfer bag 21 to the storage scale 29 and then such coupons, the customer need only scan the coupon 
place a new bag on the bag holders 19 and 20 of packing over the laser scanner .14 instead of having to enter the 
scale 23. The customer is asked to press any button 1 to coupon amount. After the 'Coupon Algorithm' has 
10 when ready. At this point the 'Change Bag Algo- 40 successfully finished, control passes back to point 'B' on 
rithm* verifies that the weight increase on storage scale the 'Main Algorithm*. Note that the graphical image 
29 is equal to the previous weight on packing scale 23. displayed on the video display terminal 11 changes back 
If the customer tried to add an extra non-scanned item to the usual image that displays arrows pointing to the 
to the storage scale during changing of bags or tried to buttons labelled 'HELP*, 'NO BAR CODE', 
swap an inexpensive item with a more expensive non- 45 'CHANGE BAG', 'END ORDER' and 'COUPON', as 
scanned item then there will generally be a weight dis- discussed above. 

crepancy and the 'Change Bag Algorithm* will ask the In the embodiment of the present invention that is 
user to correct the situation repeatedly until the weight being considered here, buttons 6 to 10 have no particu- 
on the storage scale is within the a predetermined toler- lar label or significance for the 'Main Algorithm* at 
ance range. When the 'Change Bag Algorithm* is sue- 50 point 'B* of the algorithm, FIG. 4. If one of the buttons 
ccssfully completed control passes back to point 'B* on 6 to 10 are pressed, the condition 'Key Pressed* be- 
the 'Main Algorithm'. comes true so that control is passed to the 'Key Press 
Let us now consider the case of pressing the *END Algorithm*. However, none of the primary conditions 
ORDER* button 4. When the customer has completed of the 'Key Press Algorithm* becomes true so that con- 
scanning and bagging his/her order, he/she should 55 trol passes back to point 'B' of the 'Main Algorithm* 
press the 'END ORDER' button 4. Control is trans- without any particular operations occurring. (Of 
ferred from the 'Main Algorithm* to the 'Key Press course, one can envision equivalents of the present em- 
Algorithm* and in turn to 'End Order Algorithm*. The bodiment of the invention where pressing such a key 
'End Order Algorithm* prompts the customer, via the causes a prompt such as a thudding sound from speaker 
video display terminal 11 and speaker system 12, for any 60 12 to occur.) 

final information required such as delivery choices and It is occasionally necessary for the supervisory em- 
payment modalities. The typical embodiment of the ployee to enter a product for a customer or make a 
present invention then instructs the customer to pay the correction. If the supervisory employee presses a key 
human supervisory employee. However, it is not hard on the supervisor keyboard 57 then control passes to the 
to imagine other embodiments which use commercially 65 'Key Press Algorithm' and in turn to the 'Operator 
available magnetic credit card readers for credit or Algorithm'. The 'Operator Algorithm* consists of a 
debit card payment, commercially available electronic series of conditional tests* similar to the structure of the 
debit card readers for debit card payment or commer- 'Key Press Algorithm' which acts appropriately de- 
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pending on which key on the supervisor keyboard 57 sor module generating a fifth electrical signal; (j) a 

was pressed. For example, if the supervisory employee video display mounted in said supervisor module; (k) an 

pressed a key to allow the customer to remove an item electronic computer having access to a product lookup 

from the sac 21 he/she decided at the last minute he/she table and receiving said first, second, third, fourth and 

did not want to purchase, then the •Operator Algo- 5 fifth electrical signals; and 0) a computer program caus- 

rithm' would call a lower-level 4 Remove Item Algo- ing said electronic computer in the case of a product 

rithm' which would in turn call lower-level algorithms containing a machine readable bar code, to look up in 

to reduce the total amount of the order, to print a cor- the said product lookup table the allowable weight for 

rection on the receipt via receipt printer 55, to verify the product and to verify correspondence with the 

the new weight on packing scale 23, etc. 10 we ight addition on the said packing scale, and in the 

The high-level algorithms shown in FIG. 4 along case of a product without a valid machine readable bar 

with textual discussion of these algorithms is intended c^je t0 prcsent the cust omer with a series of choices to 

not as a comprehensive discussion of the algorithms identify the product including the option of requesting 

used in an embodiment of the present invention, but the ^ supervisory employee to identify the product 

only to be sufficient to allow one skilled in the art to 15 As men tioned above, for the sake of simplicity, in the 

construct a working automatic point-of-sale machine. embodiment being discussed here, 18 is considered to be 

One skilled in the art will be capable of producing or a ^ transmitting only images of the contents of bag 

obtaining the lower-level algorithms dictated by the n to Ac supervisor module . However, as mentioned 

algonthms shown in FIG. 4. The set of algonthms above> ^ 18 m othcr embodiments contain a 

shown in FIG. 4 is only one of many possible sets of 20 t^ee-dimensional array of light beams and detectors 

algonthms which could be used to control the function which mcasurc thc dimcnsions of Ae custorncr ' $ hand 

of the automatic pomt-of-sale machine. Using no more ^ duct m ^ b n and the cuslomer . s 

that routine expenmentauon it is possible to produce * ^ £ *. from b 21 thus M ^ 

more than routine experimentation it is possible to add 25 rf ^ . f ultr £ onic lransducers 

numerous features to the set of algonthms shown in f? , *»» v* w wuuib ^w*HMiu,_ci» 

FIG. 4. For example, a feature could be added to the wh,ch m fl e f u ' c tbe dls ^ ce from he **' d ^cm of 

•Scan Algorithm' shown in Section C of FIG. 4, * m0T ]? t0 * e t0 P of the contents of the bag 21. By 

whereby if the product information indicated that the notin * < he change in these distances after a product is 

product was heavy or of large size, then the customer 30 P* aced m ba * 21 > !t * P os «ble to compute the volume of 

would be prompted to place the product directly on thc th r e P r ^ uct ' In an embodiment where sensor 18 consists 

storage scale 29 instead of the packing scale 23. This ? f 2 vldeo camera and a light-beam dimension comput- 

algorithm could also be modified so that if the product m * *™y 311 ritrwmc transducer volume comput- 

information indicated that another product had a similar m « P lane ' the measured dimensions and volume will be 

weight, then the supervisory employee should be 35 verified dimensions and volume stored for a 

prompted to verify that the correct product has been particular product, as indicated by the product lookup 

placed in the sac 21 or on the storage scale 29, which- «? bIe - Dimensions and volume may be verified for every 

ever the case may be. The 'No Code Algorithm' could sm S le ncm P laccd m ba « 21 » or 25 mentioned earlier, 

be given a feature such that if the supervisory employee dimensions and volume may be used along with weight 

is very busy or cannot respond within several seconds, 40 «o determine that a non-labelled product identified by 

then for the case of an experienced customer who has an experienced user has in fact been correctly identified 

indicated via buttons 1 to 10 in response to choices *»d *e small minonty of cases where measured 

presented on the video display terminal 11 the product weight,dimensions and volume don't reasonably corre- 

placed in sac 21, then the product will by default be s P ond with the stored values, an image of bag 21 is 

approved so that the customer does not have wait an 45 verified by the supervisory employee, 

unreasonable amount of time for the supervisory em- Those skilled in the art will be able to ascertain, using 

ployee to approve or reject the item. n0 more than routine experimentation, -other equiva- 

An embodiment of the present invention may con- l ents *° r method and apparatus above described, 

cisely be described as a self-service checkout system Such equivalents are to be included within in the scope 

comprising: (a) a robot module; (b) a laser bar code 50 of lne following claims, 

scanner mounted in said robot module for generating a I claim: 

first electrical signal corresponding to the bar . code *« A self-service checkout system comprising: 

scanned; (c) a packing scale mounted in said robot mod- (a) a robot module; 

ule for generating a second electrical signal correspond- (b) a laser bar code scanner mounted in said robot 

ing to the weight on said packing scale where said pack- 55 module for generating a first electrical signal corre- 

ing scale is mounted in proximity to the said laser bar sponding to the bar code scanned; 

code scanner such that a customer can scan and bag a (c) a packing scale mounted in said robot module for 

product with one motion; (d) attachments on the said generating a second electrical signal corresponding 

packing scale to hold bags open and in place; (e) a video to the weight on said packing scale where said 

display mounted in said robot module; (0 user interface 60 packing scale is mounted in proximity to the said 

means operating in proximity to said video display gen- laser bar code scanner such that a customer can 

erating a third electrical signal; (g) a sensor mounted scan and bag a product with one motion; 

above the said packing scale where said sensor gerier- (d) attachments on the said packing scale to hold bags 

ates a fourth electrical signal representative of the exter- open and in place; 

nal characteristics of the contents of the packing bags; 65 (e) a first video display mounted in said robot module; 

(h) a supervisor module to be used by a supervisory (0 first user interface means operating in proximity to 

employee to supervise the operation of said robot mod- said first video display generating a third electrical 

ule; (i) user interface means mounted in the said supcrvi- signal; 
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(g) a sensor, mounted above the said packing scale 
where said sensor generates a fourth electrical 
signal representative of the external characteristics 
of the contents of the packing bags; 

(h) a supervisor module to be used by a supervisory 
employee to supervise the operation of said robot 
module; 

(i) second user interface means mounted in the said 
supervisor module generating a fifth electrical sig- 
nal; 

(j) a second video display mounted in said supervisor 
module; 

(k) an electronic computer having access to a product 
lookup table and receiving said first, second, third, 



10 



which is received and surveyed by said electronic com- 
puter. 

7. The self-service checkout system of claim 1 where 
said electronic computer contains circuitry to allow 
communications with other electronic computers. 

8. The self-service checkout system of claim 1 con- 
taining a television camera and monitor to allow the 
supervisory employee to verify that before the cus- 
tomer removes his products from the said robot module 
that no products have been fraudulently put aside and 
containing a monitor visible to the customer to make 
the customer aware that his/her actions are being sur- 
veyed. 

of claim 1 



9. The self-service checkout system 
fourth and fifth electrical signals, and sending a 15 wne reby the supervisor module contains a cash drawer, 
sixth electrical signal to said first video display and 10 xh e self-service checkout system of claim 1 
a seventh electrical signal to said second video whereby the robot module contains angles, sealed sur- 
display; faces. 
0) a computer program causing said electronic com- n self-service checkout system of claim 1 where 
puter in the case of a product containing a machine 20 ^ ^ $enlor mounted above the packing scale gener- 
readable bar code, to look up, in response to said atcs w h rcso lution color images of the product in the 
first electrical signal, in the said product lookup p ac ki n g bags 

table the allowable weight for the product and to n The ^service checkout system of claim 1 where 
verify correspondence with the weight addition on ^ ^ sensQr mounted above the packmg scale con- 
the said packmg scale as indicated by the said sec- 25 
ond electrical signal, and in the case of a product 
without a valid machine readable bar code to pres- 
ent the customer, via said sixth electrical signal via 
said first video display, with a series of choices to 
identify the product, via said first user interface 30 
means via said third electrical signal, including the 



option of requesting the said supervisory em- 
ployee, via said seventh electrical signal via said 
second display means, to identify the product via 
said second user interface means via said fifth elec- 
trical signal . and optionally in response to said 
sensed external characteristics as indicated by said 
fourth electrical signal; and 
(m) a storage scale mounted in close proximity to the 
said packing scale so that when the said packing 40 
scale becomes filled, products and their bags can be 
transferred to said storage scale which generates an 
eighth electrical signal which is received and sur- 
veyed by the said electronic computer to ensure 
that no unauthorized products are fraudulently 45 
placed on or in the bags on the said storage scale. 

2. The self-service checkout system of claim 1 in 
which a communication link exists between the robot 
module and the supervisor module to allow communi- 
cation between the customer and the said supervisory 50 
employee. 

3. The self-service checkout system of claim 1 con- 
taining a television camera and monitor to allow the 
supervisory employee to verify that before the cus- 
tomer removes his products from the said robot module 55 
that no products have been fraudulently put aside. 

4. The self-service checkout system of claim 1 con- 
taining a receipt printer attached to the said electronic 
computer to produce a printed list of the customer's 
purchases and total payment requested. 

5. The self-service checkout system of claim 1 
whereby said electronic computer contains, a human 
voice generating circuit. 

6. The self-service checkout system of claim 1 
whereby the said robot module contains a payment 
reader capable of reading forms of payment character- 
ized by credit cards, debit cards and currency, where 
such payment reader generates an electrical signal 



tains ultrasonic transducers generating said fourth elec- 
trical signal which is representative of the distances 
from the said sensor to the top of the contents in the 
packing bags and thus allows the said electronic com- 
puter to compute the increase in volume of the contents 
of the bags on the said packing scale after an item is 
placed in said bags and to verify correspondence of the 
thus net volume of the product with the volume speci- 
fied in the said product lookup table for that particular 
35 product. 

13. A self-service checkout system comprising: 

(a) a robot module; 

(b) a laser bar code scanner mounted in said robot 
module for generating a first electrical signal corre- 
sponding to the bar code scanned; 

(c) a packing scale mounted in said robot module for 
generating a second electrical signal corresponding 
to the weight on said packing scale where said 
packing scale is mounted in proximity to the said 
laser bar code scanner such that a customer can 
scan and bag a product with one motion; 

(d) attachments on the said packing scale to hold bags 
open and in place; 

(e) a first video display mounted in said robot module; 
(0 first user interface means operating in proximity to 

said first video display generating a third electrical 
signal; 

(g) a sensor mounted above the said packing scale, 
where said sensor generates a fourth electrical 
signal representative of the external characteristics 
of the contents of the packing bags; 

(h) a supervisor module to be used by a supervisory 
employee to supervise the operation of said robot 
module; 

0) second user interface means mounted in the said 
supervisor module generating a fifth electrical sig- 
nal; 

(j) a second video display mounted in said supervisor 
module; 

(k) an electronic computer having access to a product 
lookup table and receiving said first, second, third, 
fourth and fifth electrical signals, and sending a 
sixth electrical signal to said first video display and 
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a seventh electrical signal to said second video 
display; 

0) a computer program causing said electronic com- 
puter in the case of a product containing a machine 
readable bar code, to look up, in response to said 5 
first electrical signal, in the said product lookup 
table the allowable weight for the product and to 
verify correspondence with the weight addition on 
the said packing scale as indicated by the said sec- 
ond electrical signal, and in the case of a product 10 
without a valid machine readable bar code to pres- 
ent the customer, via said sixth electrical signal via 
said first video display, with a series of choices to 
identify the product, via said first user interface 
means via said third electrical signal, including the 15 
option of requesting the said supervisory em- 
ployee, via said seventh electrical signal via said 
second display means, to identify the product via 
said second user interface means via said fifth elec- 

20 



trical signal and optionally in response to said 
sensed external characteristics as indicated by said 
fourth electrical signal; and 
(m) in proximity to the said packing scale a three-di- 
mensional array of light beams and light detectors 
generating an eighth electrical signal which is re- 
ceived by the said electronic computer where in- 
terruption of the said light beams by the customer's 
hand transferring a product to the packing scale 
and by the customer's empty hand leaving the 
packing scale causes the said electronic computer 
to subtract the computed dimensions of the cus- 
tomer's hand alone from the computed dimensions 
of the customer's hand holding the product and to 
verify correspondence of the thus net dimensions 
of the product with the dimensions specified in the 
said product lookup table for that particular prod- 
uct. 
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